1 link tagged with all of: apple intelligence + on device model
Click any tag below to further narrow down your results
Links
The article looks at Core Advanced, the 20-billion-parameter model Apple ships on Macs that run Apple Intelligence, and how it fits into a Mac's memory. The author reverse-engineers nothing; instead they measure the model's footprint and behavior from outside using macOS tools and public commands.
- Apple's design keeps most of the model in flash storage and swaps in a few experts per prompt, so two seconds into a long request it holds about 2.0 GiB of memory versus roughly 15 GiB for an open model of similar class.
- The tradeoff is capability: on 20 math problems it finished last of four, and developers can't pin or tune the model, while Apple's own docs list math, code and logical reasoning as tasks to avoid.
- Apple keeps adapters for its own features while closing them to developers, and runs safety models as a separate process, so it can update screening without touching the main model.